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[Designation of Document] Specification 
[Title of the Invention] 

Magnifying observation apparatus, a method for observing the 
magnified image, a program for operating the magnifying observation 
apparatus , and a computer-readable recording medium 

[Claims] 

1 - Magnifying observation apparatus comprising imaging means for 

photographing an observed image and display means for displaying 
the observed image based on a signal acquired with said imaging means, 
said magnifying observation apparatus further comprising: 
edge detection means for performing signal processing on an 
image signal acquired with said imaging means and detecting edge 
information on an edge contained in the observed image; point 
indication means for indicating arbitrary points in the observed 
image displayed with said display means; 

edge extraction means for extracting an edge section on the 
periphery of the points indicated with said point indication means; 
and 

highlight means for performing predetermined image processing 
on the edge section extracted with. said edge extraction means and 
displaying the resulting edge section over the observed image. 
2. Magnifying observation apparatus according to claim 1, 

characterized in that said edge detection means can perform 
arithmetic operation of the geometric information on the detected 
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edge section and display the geometric information which has undergone 
arithmetic operation on the display means, 

3. Magnifying observation apparatus according to claim 1 or 2, 
characterized in that said edge detection means can detect 

only the sections matching a predetermined pattern in the edge 
information contained in the observed image. 

4. Magnifying observation apparatus according to claim 3, 
characterized in that said predetermined pattern is at least 

one of a straight line, a circle, and an arc. 

5 . Magnifying observation apparatus according to any one of claims 

1 through 4, 

characterized in that said magnifying observation apparatus 
further comprises arithmetic operation means for executing 
predetermined arithmetic operation based on the extracted edge 
section. 

6. Magnifying observation apparatus according to claim 5, 

characterized in that said point indication means can select 

a plurality of edge sections by indicating a plurality of points 

in a single observed image and extracting the respective edge sections 

corresponding to these points and 

that said arithmetic operationmeans can execute predetermined 

arithmetic operation based on the selected edge sections and display 

the results on said display means. 

7 . A method for observing a magnified image which uses magnifying 

observation apparatus comprising imaging means for photographing 
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an observed image and display means for displaying the observed image 
based on a signal acquired with said imaging means , said method 
comprising : 

a step of performing signal processing on an image signal 
acquired with said imaging means and detecting edge information on 
an edge contained in the observed image; 

a step of indicating arbitrary points in the observed image 
displayed with said display means ; a step of extracting an edge section 
on the periphery of the points indicated based on the edge information 
on the observed image; and 

a step of performing predetermined image processing on the 
edge section extracted and displaying the resulting edge section 
over the observed image* 

8 , A method for observing a magnified image according to claim 
7, 

characterized in that said edge method further comprises a 
step of operating geometric information on the detected edge section 
and displaying the geometric information which has undergone 
arithmetic operation on the display means . 

9 . A method for observing a magnified image according to claim 
7 or 8, 

characterized in that said edge detection step detects only 
the sections matching a predetermined pattern in the edge information 
contained in the observed image . 

10. A method for observing a magnified image according to claim 
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9, 

characterized in that said predetermined pattern is at least 
one of a straight line, a circle, and an arc. 

11. A method for observing a magnified image according to any one 
of claims 7 through 10, 

characterized in that said method further comprises a step 
of executing predetermined arithmetic operation based on the 
extracted edge section* 

12 . A method for observing a magnified image according to claim 
11, 

characterized in that said method can select a plurality of 
edge sections by indicating a plurality of points in a single observed 
image and extracting the respective edge sections corresponding to 
these points and 

that said method further comprises a step of executing 
predetermined arithmetic operation based on the selected edge 
sections and displaying the results on said display means. 
13. A program for operating the magnifying observation apparatus 
comprising imaging means for photographing an observed image and 
display means for displaying the observed image based on a signal 
acquired with said imaging means, 

said program causing a computer to serve as: 

edge detection means for performing signal processing on an 
image signal acquired with said imaging means and detecting edge 
information on an edge contained in the observed image; point 
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indication means for indicating arbitrary points in the observed 
image displayed with said display means; 

edge extraction means for extracting an edge section on the 
periphery of the points indicated with said point indication means; 
and 

highlight means for performing predetermined image processing 
on the edge section extracted with said edge extraction means and 
displaying the resulting edge section over the observed image. 
14 - A computer-readable recording medium which stores the program 
for operating the magnifying observation apparatus according to claim 
13 . 

[Detailed Description of the Invention] 
[0001] 

[Technical Field to which the Invention Belongs] 

The present invention relates to magnifying observation 
apparatus for photographing and displaying a magnified image such 
as a microscope, a method for observing a magnified image, a program 
for operating the magnifying observation apparatus, and a 
computer-readable recording medium. 
[0002] 
[Prior Art] 

Today, optical microscopes and digital microscopes are in use 
as magnifying observation apparatus which display magnified 
micro-objects . A microscope is equipped with a photoreceptor device 
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such as a CCD for electrically reading, per pixel arranged 
two-dimensionally, a reflected light or a transmitted light from 
an observation sub j ect fixed to the observation sub j ect fixing section 
incident via an optical system. The microscope displays on the 
display section such as a display an image electrically read using 
a CCD (for example seethe Japanese Patent Laid-Open No . 2000-214790). 
[0003] 

It is a common practice that an operator uses an imaging system 
such as a microscope to manually measure the dimensions of an image 
on the display- For example, when measuring a dimension from one 
section to another on the screen, the operator specifies a single 
point on the screen with a pointing device such as a mouse then another 
point to perform measurement of the distance between the two points . 
[0004] 

[0005] 

[Problems that the Invention is to Solve] 

However, in case dimensions are measured on the display by 
way of manual operation, there arise variations in the measurement 
results depending on the person who performed measurement. While 
an operator specifies the measurement points while watching the screen 
in manual operation, which points are to be specified as measurement 
points depends on the operator- For example, when a boundary is 
specified, which section is specified as a boundary depends on the 
operator- This results in variations between persons who perform 
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measurement. Such variations cause measurement errors thus 
degrading the reproducibility of measurement . In particular , in case 
the diameter of a circle is to be measured, specification of 
measurement points is likely to be subject to variations. 
[0006] 

The invention has been accomplished in order solve the 
aforementioned problems and mainly aims at providing magnifying 
observation apparatus, a method for observing a magnified image, 
a program for operating the magnifying observation apparatus, and 
a computer-readable recording medium which can eliminate errors 
between users and obtain measurement results with high 
reproducibility based on predetermined standards. 
[0007] 

[Means for Solving the Problems] 

In order to attain the object, the invention provides, in its 
first aspect, magnifying observation apparatus comprising imaging 
means for photographing an observed image and display means for 
displaying the observed image based on a signal acquired with the 
imaging means, the magnifying observation apparatus further 
comprising: edge detection means for performing signal processing 
on an image signal acquired with the imaging means and detecting 
edge information on an edge contained in the observed image; point 
indication means for indicating arbitrary points in the observed 
image displayed with the display means; edge extraction means for 
extracting an edge section on the periphery of the points indicated 
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with the point indication means; and highlight means for performing 
predetermined image processing on the edge section extracted with 
the edge extraction means and displaying the resulting edge section 
over the observed image. This configuration eases the decision of 
an edge section, eliminates variations between users and facilitates 
specification of points. 
[0008] 

The invention provides, in its second aspect, magnifying 
observation apparatus according to the first aspect, characterized 
in that the edge detection means can perform arithmetic operation 
of the geometric information on the detected edge section and display 
the geometric information which has undergone arithmetic operation 
on the display means. With this configuration, it is possible to 
display geometric information on the detected edge section, for 
example the information on the size and position of the edge section. 
[0009] 

The invention provides, in its third aspect, magnifying 
observation apparatus according to the first or second aspect, 
characterized in that the edge detection means can detect only the 
sections matching a predetermined pattern in the edge information 
contained in the observed image. With this configuration, it is 
possible to readily select only a necessary edge section without 
being puzzled by an unnecessary edge. 
[0010] 

The invention provides, in its fourth aspect, magnifying 
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observation apparatus according to the third aspect, characterized 
in that the predetermined pattern is at least one of a straight line, 
a circle, and an arc. With this configuration, the user can readily 
select a pattern such as a straight line. 
[0011] 

Further, the invention provides, in its fifth aspect, 
magnifying observation apparatus according to any one of the first 
through fourth aspects, characterized in that the magnifying 
observation apparatus further comprises arithmetic operation means 
for executing predetermined arithmetic operation based on the 
extracted edge section. With this configuration, it is possible to 
execute arithmetic operation of the distance and area based on the 
uniquely extracted edge section, thus obtaining arithmetic operation 
results with high reproducibility. 
[0012] 

The invention provides, in its sixth aspect, magnifying 
observation apparatus according to the fifth aspect, characterized 
in that the point indication means can select a plurality of edge 
sections by indicating a plurality of points in a single observed 
image and extracting the respective edge sections corresponding to 
these points and that the arithmetic operation means can execute 
predetermined arithmetic operation based on the selected edge 
sections and display the results on the display means. With this 
configuration, it is possible to execute arithmetic operation of 
the length, inclination and area based on one or a plurality of edge 
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sections. For example, it is possible for any user to execute 
arithmetic operation of the area of a specified region or distance 
between specified two points, with the same results obtained. 
[0013] 

The invention provides, in its seventh aspect, a method for 
observing a magnified image which uses magnifying observation 
apparatus comprising imaging means for photographing an observed 
image and display means for displaying the observed image based on 
a signal acquired with the imaging means, the method comprising: 
a step of performing signal processing on an image signal acquired 
with the imaging means and detecting edge information on an edge 
contained in the observed image; a step of indicating arbitrary points 
in the observed image displayed with the display means; a step of 
extracting an edge section on the periphery of the points indicated 
based on the edge information on the observed image; and a step of 
performing predetermined image processing on the edge section 
extracted and displaying the resulting edge section over the observed 
image * This configuration eases the specification of an edge section 
with high reproducibility. 
[0014] 

The invention provides, in its eighth aspect r a method for 
observing a magnified image according to the seventh aspect, 
characterized in that the edge method further comprises a step of 
performing arithmetic operation of the geometric information of the 
detected edge section and displaying the geometric information which 
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has undergone arithmetic operation on the display means . With this 
conf iguration, the user can check the information on the desired 
edge section. 
[0015] 

The invention provides, in its ninth aspect, a method for 
observing a magnified image according to the seventh or eighth aspect , 
characterized in that the edge detection step detects only the sections 
matching a predetermined pattern in the edge information contained 
in the observed image. With this configuration, it is possible to 
readily extract only a desired edge section without inadvertently 
extracting an unnecessary edge section. 
[0016] 

The invention provides, in its tenth aspect, a method for 
observing a magnified image according to the ninth aspect, 
characterized in that the predetermined pattern is at least one of 
a straight line, a circle, and an arc. With this configuration, the 
user can readily select a pattern such as a straight line. 
[0017] 

Further, the invention provides, in its eleventh aspect, a 
method for observing a magnified image according to any one of the 
seventh through tenth aspects, characterized in that the method 
further comprises a step of executing predetermined arithmetic 
operation based on the extracted edge section. With this 
configuration, it is possible to readily and uniquely select an edge 
section, thus obtaining arithmetic operation results with high 
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reproducibility based on the selected edge section. 
[0018] 

The invention provides, in its twelfth aspect, a method for 
observing a magnified image according to the eleventh aspect r 
characterized in that the method can select a plurality of edge 
sections by indicating a plurality of points in a single observed 
image and extracting the respective edge sections corresponding to 
these points and that the method further comprises a step of executing 
predetermined arithmetic operation based on the selected edge 
sections and displaying the results on the display means . With this 
configuration, the user can readily obtain the arithmetic operation 
results on one or a plurality of edges. For example, the user knows 
the area of a specified region or distance between specified two 
points from the screen. 
[0019] 

The invention provides, in its thirteenth aspect, a program 
for operating the magnifying observation apparatus comprising 
imaging means for photographing an observed image and display means 
for displaying the observed image based on a signal acquired with 
the imaging means, the program causing a computer to serve as: edge 
detection means for performing signal processing on an image signal 
acquired with the imaging means and detecting edge information on 
an edge contained in the observed image; point indication means for 
indicating arbitrary points in the observed image displayed with 
the displaymeans ; edge extractionmeans for extracting an edge section 
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on the periphery of the points indicated with the point indication 
means; and highlight means for performing predetermined image 
processing on the edge section extracted with the edge extraction 
means and displaying the resulting edge section over the observed 
image. This configuration uniformly determines an edge section thus 
obtaining high reproducibility without variations between users. 
[0020] 

Further, the invention provides, in its fourteenth aspect, 
a computer-readable recording medium which stores the program for 
operating the magnifying observation apparatus according to the 
thirteenth aspect . 
[0021] 

The recoding media include magnetic disks, optical discs, 
magneto-optical disks, and other media such as semiconductor memories 
which can store programs . 
[0022] 

[Mode for Carrying Out the Invention] 

Embodiments of the invention will be described referring to 
the drawings. The following embodiments illustrate magnifying 
observation apparatus, a method for observing a magnified image, 
a program for operating the magnifying observation apparatus, and 
a computer-readable recording medium used to embody the technical 
thoughts of the invention. Note that the invention is not limited 
to the following magnifying observation apparatus, method for 
observing a magnified image, program for operating the magnifying 



13 



observation apparatus, and computer-readable recording medium. 
[0023] 

The specification does not limit the members defined in the 
claims to those in the embodiments. The size of each member and 
relation between the members are exaggerated depending on the drawings 
for simplicity. 
[0024] 

Connection between magnifying observation apparatus used in 
the embodiment of the invention and a computer, printer, an external 
storage device and other peripherals for performing processing 
including operation, control, and display is made electrically, 
magnetically or optically to perform communications via, for example, 
serial connection such as IEEE1394, RS-232x and RS-422, and UBS, 
parallel connection, or a network such as 10BASE-T, 100BASE-TX, and 
100BASE-T. The connection is not limited to a wired physical 
connection but may be a wireless LAN such as IEEE8 02.11x or wireless 
connection using radio waves , infrared rays or optical communications 
such as Bluetooth * A recording medium for exchanging data and saving 
the setting may be a memory card, a magnetic disk, an optical disc, 
a magneto-optical disk, and a semiconductor memory. 
[0025] 

The magnifying observation apparatus according to the 
embodiment of the invention will be described using Figs. 1 through 
6. As shown in Fig . 1, the magnifying observation apparatus comprises 
an illumination section 60 for illuminating an observation subject, 
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an imaging section 10 for photographing the observation subject 
illuminated with the illumination section 60 , and a display 52 for 
displaying a magnified image photographed with the imaging section 
10. 

[0026] 

To be more specific, as shown in Fig. 2, the imaging device 
10 comprises a stage 30 for mounting the observation subject S as 
a form of an observation subject fixing section, a stage elevator 
2 0 for moving the stage 30 up and down, a CCD 12 as an image pick-up 
device for electrically reading per pixel arranged two-dimensionally 
a reflected light or a transmitted light incident into an observation 
subject fixed to the stage 30 via an optical system, and a CCD control 
circuit for performing drive control of the CCD 12. Further, an 
information processor 50 as a magnifying observation apparatus main 
unit is connected to the imaging section 10. The information 
processor 50 comprises a memory 53 as an image data storage for storing 
image data electrically read by the image pick-up device r a display 
52 such as a display and a monitor as a form of display means for 
displaying an image based on the image data electrically read by 
the image pick-up device, an input section 55 for performing operations 
such as input based on a screen displayed on the display 52, and 
a controller 51 for performing processing such as image processing 
based on the information input with the input section. 
[0027] 

The input section is coupled to a computer via wired or wireless 
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connection, or fixed to the computer. A general input section 55 
includes, for example, a mouse or a keyboard, and various pointing 
devices such as a slide pad, a track point, a tablet, a joystick, 
a consol, a jog dial, a digitizer, a light-pen, a ten-key pad, a 
touch pad, and an acupoint . The input section 55 maybe used to operate 
a program for operating magnifying observation apparatus as well 
as the magnifying observation apparatus and its peripherals . Further, 
a touch screen or touch panel may be used as a display to provide 
an interface screen so that the user can directly touch the screen 
with his/her hand for input or operation- Alternately, voice input 
or any other existing input means or a combination of these may be 
used. In the example of Fig. 1, the input section 55 is a mouse 55a. 
[0028] 

Fig. 1 shows an external view of magnifying observation 
apparatus according to an embodiment of the invention- A camera 10a 
comprising an optical system and an image pick-up device is attached 
to a camera attaching section 43 fixed to a support extending 
vertically from a stand 41 . On the stand 41 is arranged a stage elevator 
2 0 on top of which is attached a stage 30 for placing an observation 
subject S. The camera 10a and the stage elevator 20 are connected 
to and controlled by the information processor 50. The information 
processor 5 0 comprises a display 52 and an input section 55 such 
as a mouse 55a. On the display 52 are displayed an observed image 
display 52A and an observed image 52a. 
[0029] 
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A computer 70 may be connected to the magnifying observation 
apparatus as the information processor 50 . By separately installing 
a program for operating the magnifying observation apparatus in the 
computer 70 , the magnifying observation apparatus may be operated 
remotely from the computer 70. In the specification, the program 
for operating the magnifying observation apparatus using a computer 
includes an operation program installed in a general-purpose or 
dedicated computer externally connected to the magnifying 
observation apparatus and an operation program incorporated into 
the information processor 50 as a controller of the magnifying 
observation apparatus . In the magnifying observation apparatus, an 
operation feature or operation program to operate the magnifying 
observation apparatus is previously incorporated. The operation 
program may be installed into the magnifying observation apparatus 
in the form of rewritable software or firmware or may be updated 
as required- Thus, in the specification, a computer to execute a 
program for operating the magnifying observation apparatus includes 
the magnifying observation apparatus itself. 
[0030] 

Fig- 2 shows a block diagram of magnifying observation apparatus 
according to an embodiment of the invention. The information 
processor 50 comprises a display 52 as display means, a memory 53 
for storing a control program, focal length information, light 
reception data and two-dimensional information, an interface 54 used 
by the information processor 50 to communicate with the camera 10a 
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and the stage elevator 20, and an input section 55 used by the operator 
to perform operation concerning magnifying observation apparatus. 
The stage elevator 20 comprises, for example, a stepping motor 21 
and a motor controller 22 for controlling elevation of the stepping 
motor 21- An imaging section 10 comprises, for example, a 
photoreceptor device such as a CCD 12 serving as an image pick-up 
device, a CCD controller circuit 13 for performing drive control 
of the CCD 12, and an optical system 11 for forming on the CCD 12 
an image of a reflected light or a transmitted light of a light 
irradiated onto an observation subject S placed on the stage 30 from 
the illumination section 60. 
[0031] 

The imaging section 10 can further comprise pixel shift means 
to obtain a resolution exceeding the resolution of the CCD by way 
of pixel shift. The pixel shift is a process of compounding an image 
and another image obtained by photographing the subject with half 
pixel pitch shifted in order to obtain a higher resolution. 
Representative pixel shift mechanisms include the CCD drive system 
to shift an image pick-up device, the LPF inclination system to incline 
LPF, and the lens shift system to shift a lens. In Fig. 2, an optical 
path shift section 14 is provided for optically shifting the incident 
light path of a reflected light a transmitted light of a light incident 
onto the CCD 12 from the observation subject S fixed to the stage 
30 via the optical system, at least in a single direction, at a distance 
smaller than the interval between two adjacent pixels of the CCD 
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12 in the direction. The mechanisms or approaches for enabling the 
pixel shift are not limited to the aforementioned configurations 
but well known methods and methods to be developed in future may 
be available. 

[0032] 

The informationprocessor 50 inputs control data on the control 
of the stepping motor 21 into the motor control circuit 22 to vary 
the relative distance between the stage 30 as an observation subject 
fixing section and the camera 10a comprising the optical system 11 
and the CCD 12 as a photoreceptor device in the optical axis direction, 
or height in the z direction in this example. In particular, the 
information processor 50 inputs control data necessary to control 
the stage elevator 20 into the motor control circuit 22 to control 
rotation of the stepping motor 21 and elevates/lowers the height 
z (position in the z direction) of the stage 30. The stepping motor 
21 generates a rotation signal in accordance with the rotation. The 
information processor 50 stores the height z of the stage 30 as 
information on the relative distance between the observation subject 
fixing section 30 and the optical system 11 in the optical axis 
direction. While the relative distance between the observation 
subject fixing section 30 and the optical system 11 in the optical 
axis direction is varied by varying the height of the stage 30 in 
this embodiment, the stage 30 may be fixed and the height of the 
optical system 11, for example the height of the camera 10a may be 
varied. 
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[0033] 

The CCD 12 can electrically read the quantity of photoreception 
per pixel arranged two-dimensionally . The image of the observation 
subject S formed on the CCD 12 is converted to an electrical signal 
in each pixel in accordance with the quantity of photoreception and 
converted to digital data in the CCD control circuit 13. The 
information processor 5 0 stores into a memory 53 the digital data 
from the CCD control circuit 13 as photoreception data D together 
with the pixel arrangement information (x, y) as the two-dimensional 
position information of an observation subject in a plane (x and 
y directions in Fig. 2) approximately perpendicular to the optical 
axis direction (z direction in Fig. 2) . The plane approximately 
perpendicular to the optical axis direction need not be a plane 
strictly at aright angle from the optical axis but may be an observation 
plane within the range of inclination where the shape of the 
observation subject can be recognized at the resolution of the optical 
system and the photoreceptor device . 
[0034] 

While the observation subject is placed on the stage as an 
example of observation subject fixing section in the foregoing 
description, an arm may be attached instead of a stage and an 
observation subject may be fixed to the tip of the arm. The camera 
10a may be attached to the camera attaching section 43 as mentioned 
earlier, and may be detachable and arranged at a desired position 
and a desired angle by holding the camera with hands. 
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[0035] 

The illumination section 60 shown in Fig. 1 comprises an 
incident-light illumination 60A for irradiating an incident light 
and a transmitting illumination 60B for irradiating a transmitted 
light. These illuminations are connected to the information 
processor 50 via the optical fiber 61. The information processor 
50 comprises a connector 62 for connecting the optical fiber 61 and 
incorporates a light source (not shown) for transmitting a light 
to the optical fiber 61 via the connector 62. The light source may 
be a halogen lamp. 
[0036] 

[Controller 51] 

Acontroller 51 functions as edge detectionmeans for performing 
signal processing on an image signal and detecting edge information 
edge extraction means for extracting an edge section on the periphery 
of the points indicated with a mouse based on the edge information, 
highlight means for performing predetermined image processing on 
the edge section extracted and displaying the resulting edge section 
over the observed image, and arithmetic operation means for executing 
predetermined arithmetic operation based on the extracted edge 
section. 
[0037] 

[Edge detection means] 

The controller 51 as edge detection means detects edge 
information on an edge contained in an observed image . The edge 
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information includes position information on the coordinates such 
as the ends, or the starting point and endpoint of an edge, radius 
and center, and information on the size. The edge information may 
include information on the observed image, such as the image size 
and date of recording. Moreover, the results of predetermined 
arithmetic operation are recorded as edge information. The results 
of predetermined arithmetic operation are for example the area of 
a selected region, a distance between regions, and inclination. 
[0038] 

In the specification, an edge refers to the boundary of an 
image extractable by image processing. The shape of an observation 
subject need not have an edge. For example, in case a pattern is 
drawn in a plane, the contour of the pattern constitutes an edge 
in the specification. 
[0039] 

To detect edge information, the controller 51 performs noise 
removal processing on the binary image data comprising the binary 
data D' obtained by conversion of the photoreception data D from 
the CCD converter circuit 13 into binary data and the pixel arrangement 
information (x, y) . The controller 51 further determines a boundary 
in the binary image data which has undergone noise removal processing 
and extracts the boundary as edge information. Then the controller 
51 extracts patterns of geometric shapes such as a straight line, 
an arc, a circle, and an ellipse based on the characteristics of 
continuity of edge information in the plane where pixel are arranged. 
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The controller 51 performs arithmetic operation of geometric 
numerical values representing the characteristics based on the types 
of geometric shapes such as the straight line, arc f circle , and ellipse 
detected- 
[0040] 

The geometric numerical values include, for a straight line, 
an angle with respect to a horizon, length of a line segment, starting 
point coordinates and endpoint coordinates on the screen. For an 
arc, the geometric numerical values include the starting point angle 
and the endpoint angle of an arc with respect to a horizon, length 
of the arc, radius of the arc, and center coordinates of the arc 
on the screen on the display 52 . For a circle , the geometric numerical 
values include the length of a circle, radius of the circle, and 
center coordinates of the circle. For an ellipse, the geometric 
numerical values include the major axis and minor axis of an ellipse, 
foci distance of an ellipse, focal coordinates, and circularity. 
The edge information detected in this way is stored into a memory 
53. 

[0041] 

Detection of an edge is not limited to the aforementioned method . 
As image processing for extracting an edge section from an observed 
image, well known methods and methods to be developed in future are 
available. The controller 51 may, by way of software, read image 
data stored in the memory 53 as an image data storage and perform 
binary image data conversion, noise removal and edge detection to 
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detect an edge section. Or, the controller 51 may comprise, as a 
hardware design, a binary image data converter circuit, a noise removal 
circuit and an edge detector circuit to detect an edge section, A 
combination of software and hardware approaches may be used. The 
information processor 5 0 stores the coordinates of a boundary at 
an edge section such as a straight line, an arc, a circle and an 
ellipse thus detected into the memory 53 as edge information. 
[0042] 

[Edge extraction means] 

From the edge information thus obtained, the controller 51 
further extracts only an edge section positioned in close proximity 
to the specified point- When the user specifies one point of an 
observed image as a point by way of point indication means, the edge 
extraction means searches for and extracts an edge section on the 
periphery of the point. The point indication means for indicating 
a point may be a pointing device such as a mouse 55a. The point is 
indicated with a mouse cursor C on the display 52, as shown in Figs. 
3 through 5. For the timing of extraction of an edge section may 
be an arbitrary timing specified by the user with a click on the 
mouse. Or, an edge section may be automatically extracted by the 
approach of the mouse cursor. 
[0043] 

Extraction of an edge is made within a predetermined range 
using the point as a reference. For example, edge extraction is 
determined based on the shortest distance between the coordinates 
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indicated by the mouse cursor C and the coordinates of a boundary 
in the edge section. The shortest distance is may be specified as 
a preset value or may be arbitrarily set by the user. Or, it is 
determined whether an edge section is contained in a circle having 
a predetermined radius whose center is the point or a rectangle region 
having vertices as points. In case an edge section is contained, 
the edge section is selected and undergoes the highlight processing 
mentioned later. In case a plurality of edge sections are contained, 
they are judged in predetermined order. For example, only the edge 
section closest to the point is selected. In case an edge section 
is not contained in close proximity to the point, no edge sections 
are selected. For example, different screenmessages maybe displayed 
between a case where an edge section is selected and a case where 
one is not selected* A sound effect or voice guidance may be used. 
Or, an alarm message may be displayed on the screen or an alarm sound 
maybe issued for guidance only in case an edge section is not selected. 
[0044] 

Further, a selection approach called snap feature may be 
employed: the end or midpoint of an edge, center or center of gravity 
of a region enclosed by an edge are extracted as characteristic points 
for automatic selection. In this case, the mouse cursor C may move 
to trace the selected characteristic points, or only selection may 
be made with travel of the mouse cursor C. The characteristic points 
to be extracted may be geometric graphic information on the edge 
section or graduations of a ruler, grid line, or arbitrary guide 
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In this embodiment, an edge section is- uniquely selected by way of 
the aforementioned means, so that the arithmetic operation results 
obtained based on this selection is independent of operators and 
with high reproducibility- The arithmetic operation section may 
perform arithmetic operation based on a plurality of edge sections 
selected. For example, the shortest distance from an end of an edge, 
distance between center points, tangent, drawing of a normal and 
the distance, measurement of inclination, and distance between the 
specified two points may be readily made by any user with the same 
results- Which arithmetic operation is to be performed may be 
individually determined by the user or arithmetic operation to be 
performed may be set in advance. The timing of arithmetic operation 
may be specified by the user on an arbitrary basis or automatically 
displayed in an information display region 52C when the edge section 
is selected. A single click of mouse may be used to select the edge 
section and a double click to perform arithmetic operation. 
[0047] 

[Selection of edge section] 

Next, the procedure to select an edge section contained in 
an observed image will be described referring to Figs. 3 through 
5. In these figures, the edge section of an image close to the point 
specified by a pointing device 55a is displayed while highlighted 
on the display 53. Fig. 3 is a general view showing edge extraction 
of a straight line L . Fig , 3A shows an original observed image . Fig . 
3B shows the image over which is displayed the extracted edge of 
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line provided on the display 52. Which characteristic points are 
to be selected or selected on a preferential basis may be determined 
by the user. The snap range may be specified by the user. 
[0045] 

[Highlight means] 

The edge section thus extracted and selected undergoes 
predetermined image processing by the controller 51 as highlight 
means and displayed over the observed image . The highlight processing 
is made on' the geometric shapes such as a line segment or an arc 
extracted as and edge. To be more specific, the processing performs 
color conversion, or changes the color of the edge section or colors 
the edge, represents the edge in dotted lines or bold lines, and 
causes the edge to blink. Or, image processing may be done to elevate 
or lower the brightness of the image data in the edge section. The 
edge section which has undergone highlight processing is displayed 
over the original observed image, so that the user can visually 
understand which edge has been selected. 
[0046] 

[Arithmetic operation means] 

The controller 51 also functions as arithmetic operation means 
for executing predetermined arithmetic operation based on the 
selected edge section. The predetermined arithmetic operation 
includes operation of the length or inclination of a line segment 
and the area of a region in the edge section . These undergo arithmetic 
operation based on the coordinate position of the selected edge section . 
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the straight line L being highlighted. 
[0048] 

To obtain the observed image of Fig, 3A, the focus is adjusted 
and the height z of the stage is determined. Then a magnified image 
is read using the camera 10a. In Fig. 3A f the point (mouse cursor 
C) in the image indicated by the pointing device 55a indicates a 
position apart from the edge section in the image- The image stored 
into the memory 53 as an image data storage is displayed on the display 
52 without the edge section being highlighted. Next, in Fig. 3B, 
the mouse cursor C indicates the periphery of the straight line L 
as an edge section of the image. The edge section detected by the 
controller 51 is highlighted and displayed on the display 52 for 
example as a straight line color-converted to red (straight line 
L in dotted lines in Fig. 3) . 
[0049] 

In this practice, the controller 51 performs arithmetic 
operation of the geometric information H on the straight line L, 
for example "straight line" as the type of geometric shape, "angle" 
with respect to a horizon on the screen on the display 52 and "length 
of line segment" on the screen as numerical values concerning geometric 
shape* Such information is displayed as edge information in the 
information display region 52C of the display 52. 
[0050] 

Next, edge extraction of an arc A is described referring to 
Fig. 4. Fig. 4 A is a general view of an original image containing 
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the arc. Fig, 4B is a general view of a highlighted image of Fig. 
4A. Fig- 4A shows an image read with the camera 10a when the focus 
is adjusted and the e¥height z of the stage is determined. In Fig, 
4A, the mouse cursor C indicates a position apart from the edge section 
in the image. The image stored into the memory 53 as an image data 
storage is displayed on the display 52 without the edge section being 
highlighted. Next, in Fig- 4B, the mouse cursor C indicates the 
periphery of the arc A as an edge section of the image. The edge 
section detected by the controller 51 is highlighted and displayed 
on the display 52 for example as an arc color-converted to red (arc 
A represented in dotted lines in Fig, 4) . In this practice, the 
geometric information H on arc A, for example arc as the type of 
geometric shape, starting point angle and endpoint angle with respect 
to a horizon on the screen on the display, and length of the arc 
and radius of the arc are displayed as numerical values concerning 
geometric shape. 
[0051] 

Fig, 5 shows a case where a plurality of edge sections are 
selected and arithmetic operation is performed based on the selected 
sedge sections . In Fig . 5 , edge extraction is selected on two circles 
Al, A2 on the display 52. The distance between the centers of these 
circles and the angle formed between the straight line connecting 
the centers and a horizontal plane are displayed in the information 
displayregion52C. InFig. 5, the circle Al as anedge section detected 
with the indication of the mouse cursor C is highlighted. The 
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geometric information on the circle Al is displayed in the information 
display region 52C on the display by way of operation such as a double 
click. Meanwhile, the circle A2 as an edge section detected with 
the indication of the same mouse cursor C is highlighted. The 
geometric information on the circle A2 can be also displayed in the 
information display region 52C on the display by way of operation 
such as a double click. 
[0052] 

In this way, on the magnifying observation apparatus according 
to an embodiment of the invention, the controller 51 can detect a 
plurality of edge sections and set the geometric information as a 
target to be displayed on the display- The edge sections whose 
geometric information are set as a target to be displayed on the 
display may undergo highlight processing different from that on the 
edge section detected with the indication of the mouse cursor C. 
For example, the edge sections extracted and selected undergo color 
conversion into red. The edge sections whose geometric information 
is set as a target to be displayed undergo color conversion into 
blue. The controller 51 performs arithmetic operation of geometric 
numerical values between the two circles Al, A2 and displays on the 
display 52 the values as the geometric information on the regions 
between edge sections subjected to arithmetic operation. The 
geometric numerical values between the two circles Al, A2 include 
the distance between the centers of circles and the angle of the 
straight line connecting the centers of the circles with respect 
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to a horizon on the screen on the display. When the edge sections 
are a circle and a straight line, for example, a normal may be drawn 
from the center of the circle to the straight line or a tangent from 
the end of the line segment toward the circle, then the length and 
inclination of these lines may undergo arithmetic operation for later 
display. 
[0053] 

While the geometric numerical values on the circles as two 
edge sections undergo arithmetic operation in this example, it is 
possible to extract more than two edge sections and performarithmetic 
operation of the geometric numerical values between the edge sections, 
then display the results on the display 52- The geometric numerical 
values between the edge sections are not limited to the distance 
between the centers of the circles and the angle of the straight 
line connecting the centers, but includes a variety of geometric 
numerical values such as the shortest distance between the centers 
of the circle and the arc and the straight line, the shortest distance 
between the circumference of the circle and the arc and the straight 
line, and the angle formed between two straight lines. 
[0054] 

[Edge section selection procedure] 

Next, the operation of the magnifying observation apparatus 
according to an embodiment of the invention will be described. Fig. 
6 is a flowchart showing the operation of the magnifying observation 
apparatus according to an embodiment of the invention. When the 
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magnifying observation apparatus is activated, a camera 10a, a stage 
elevator 20 and an information processor 50 are initialized (step 
SI) . Next, thepoint in the image displayed on a display 5 2 is indicated 
by a pointing device 55a (step S2) * 
[0055] 

Next, it is determined whether an edge section previously 
detected by the controller 51 is present on the periphery of a point 
indicated by the pointing device 55a (step S3) - Determination on 
whether an edge section is present on the periphery of the indicated 
point is made by determining whether the shortest distance between 
the indicated point and the edge section is below a predetermined 
value _ 
[0056] 

When it is determined that an edge section is present on the 
periphery of a point indicated by the pointing device 55a in step 
S3, the edge section undergoes color conversion to red as highlight 
processing and displayed on the display 52 (stepS4) . When a plurality 
of edge sections are present on the periphery of the indicated point, 
the edge section whose shortest distance is the smallest undergoes 
highlight processing first and displayed on the display 52 . In case 
it is determined that an edge section is absent on the periphery 
of the point indicated by the pointing device 55a in step S3, execution 
proceeds to step S2 and the same operation is repeated* In step S4, 
the edge section which has undergone highlight processing and is 
displayed is selected. Then the edge section is set as a target of 
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arithmetic operation of geometric information on the edge section, 
and the corresponding geometric information is displayed (step S3) . 
[0057] 

The foregoing example shows a case where the edge section 
color-converted to red as highlight processing and displayed is 
selected, and is set as a target of arithmetic operation of the 
geometric information on the edge section. The edge section whose 
geometric information is to be displayed on the display may be set 
by way of setting operation such as a double click. With this 
configuration, in case the controller detects a plurality of edge 
sections, the operator can use setting operation such as a double 
click to select as required the edge section whose geometric 
information is to be displayed on the display. In this case, the 
edge section set as a target whose geometric information is to be 
displayed on the display preferably undergoes highlight processing 
different from that on the edge section detected with the indication 
of the mouse cursor C, for example color-converted to blue before 
it is displayed. With this configuration, the operator can 
discriminate between the previously set edge section (represented 
in blue} and the edge section to be set (represented in red) . 
[0058] 

While a case where a reflected light from the sample of an 
observation subject fixed to the observation subject fixing section 
is electrically read in the foregoing embodiment, a light may be 
irradiated from behind the sample and the transmitted light may be 
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electrically read. While the sample is placed on the stage as an 
example of the observation subject fixing section, an arm may be 
attached instead of a stage and the sample may be fixed to the tip 
of the arm. 
[0059] 

While an edge is extracted automatically and highlighted on 
the display when the mouse cursor C is brought closer, an edge may 
be extracted only in case some requesting operation is made, for 
example, a click of mouse. 
[0060] 

The processing in the embodiment may be executed by way of 
program software executable on a computer or hardware such as a 
predetermined gate array { FPGA and ASIC) - The processing may be 
executed by way of a combination of program software and partial 
hardware modules to implement part of components in Figs* 1 and 2. 
In case hardware is included, the components need not be identical 
with the configuration shown in Figs. 1 and 2, but the components 
whose features are substantially identical and the components 
equipped with the feature of a plurality of components shown in Figs . 
1 and 2 are included in the invention. 
[0061] 

[Advantage of the Invention] 

As mentioned earlier, according to magnifying observation 
apparatus, a method for observing the magnified image, a program 
for operating the magnifying observation apparatus, and a 
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computer-readable recording medium of the invention, it is possible 
to detect an edge section in an observed image photographed, perform 
image processing such as highlight processing on the image, and 
displays the resulting image - With this configuration, it is possible 
to readily detect an edge section such as a circle and a straight 
line and uniquely determine the edge section. This allows any 
operator to obtain the measurement results and arithmetic operation 
results with high reproducibility. 

[Brief Description of the Drawings] 

Fig . 1 is a general view of the magnifying observation apparatus 
according to an embodiment of the invention; 

Fig, 2 is a block diagram of the magnifying observation 
apparatus according to an embodiment of the invention; 

Fig. 3 is an image drawing of a display example of an extracted 
edge section according to an embodiment of the invention; 

Fig, 4 is an image drawing of another display example of an 
extracted edge section according to an embodiment of the invention; 

Fig. 5 is an image drawing of a display example of extracted 
edge sections according to an embodiment of the invention; and 

Fig. 6 is a flowchart showing the operation of the magnifying 
observation apparatus according to an embodiment of the invention. 

[Description of the Reference Numerals and Signs] 
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10: Imaging section 
10a: Camera 
11: Optical system 
12: CCD 

13: CCD controller 

14: Optical path shift section 

20: Stage elevator 

21: Stepping motor 

22: Motor controller circuit 

30: Stage 

41: Stand 

42: Support 

43: Camera attaching section 
50: Information processor 
51: Controller 
52: Display 

52A: Observed image display 

42C: Information display region 

52a: Observed image 

53: Memory 

54: Interface 

55 : Input section 

55a: Mouse 

60: Illumination section 

60A: Incident-light illumination 



60B: Transmitting i Illumination 

61: Optical fiber 

62 : Connector 

C: Mouse cursor 

S: Observation subject 

L: Straight line 

A: Arc 

H: geometric information 
Al, A2: Circle 

[Abstract] 
[Problem] 

Providing magnifying observation apparatus which can uniquely 
determine an edge section such as a circle and a straight line in 
an observed image photographed. 
[Means for Resolution] 

The magnifying observation apparatus includes : an imaging 
section for photographing an observed image; a display section for 
displaying the observed image; an edge detection section for 
performing signal processing on an image signal and detecting edge 
information on an edge contained in the observed image; a point 
indication section for indicating arbitrary points in the observed 
image displayed with the display section; an edge extraction section 
for extracting an edge section on the periphery of the points indicated 
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with the point indication section; and a highlight section for 
performing predetermined image processing on the edge section 
extracted and displaying the resulting edge section over the observed 
image* By detecting an edge section, performing image processing 
such as highlight processing and displaying the resulting image, 
it is readily possible to detect and validate the edge section. 
[ Selected Drawing] 
Fig. 2 



38 



1/6 




2/6 



FIG. 2 



13- 



10 

CCD CONTROL 
CIRCUIT 



12- 



CCD 




STEPPING 
MOTOR 



21 



20 <^ 



MOTOR 
CONTROL CIRCUIT 



22 



53 



50 



52 



MEMORY 



DISPLAY 



CONTROLLER 



INTERFACE 



T 

54 



INPUT 
SECTION 



T 
55 



3/6 



FIG. 3A 




4/6 




5/6 



FIG. 5 



52 




CIRCLE - CIRCLE 
DISTANCE BETWEEN THE CENTERS : 2100 
ANGLE : 15.0 



6/6 



FIG. 6 



( START ) 



SI- 



S2- 



INITIALIZATION 



MOVE THE CURSOR 




S4- 



S5- 



DISPLAYTHE EDGE 



SELECT THE EDGE 



NO 



